(19) 



(12) 



Europ&isches Patentamt 
European Patent Off ice 
Office europeen des brevets 

EUROPEAN 




(43) Date of publication: 

15.05.1996 Bulletin 1996/20 

(21) Application number: 95202928.8 

(22) Date of filing: 30.10.1995 



EP 0 712 094 A2 

PATENT APPLICATION 

(51) lnta. 6 :G06T5/00 



(84) Designated Contracting States: 

DE FR GB IT 
(30) Priority; 10.1 1.1994 US 338051 

•(71) Applicant: EASTMAN KODAK COMPANY 
Rochester, New York 14650-2201 (US) 

(72) Inventors: 

• Lee, Yongchun, 
c/o Eastman Kodak Co. 
Rochester, New York 14650-2201 (US) 



• Basile, Joseph M., 

c/o Eastman Kodak Co. 

Rochester, New York 14650-2201 (US) 
. Rudak, Peter, 

c/o Eastman Kodak Co. 

Rochester, New York 14650-2201 (US) 

(74) Representative: Blickle, K. Werner, Dipl.-lng. et al 
KODAK AKTIENGESELLSCHAFT 
Patentabteilung 
D-70323 Stuttgart (DE) 




(57) A technique, specifically apparatus and an 
accompanying method, for accurately, thresholding an 
rn^ebased on local image properties. Really lumi- 
nance variations, and particularly such a technique that 
uses multi-windowing tor providing enhanced immunity 
to image noise and lessened boundary artifacts. Specrf- 
icalfy a localized intensity gradient. G(i j). * determined 
for a pre-defined window (300) centered about each 
imaoe Dixel(ij). Localized minimum and maximum pixel 
^measures, and t^,. respectively .are ateo 
defended for another, though larger, window (330)cen- 
tered about pixel(ij). Also, a localized area gradient 
measure. GS(1 j). is determined as a 
intensity gradients for a matnx of pixel posrtions 370) 
cerrteVed about pixel position (i j). Each image pixeHu) 6 
then classified as being an object pixel. i.e.. black, or a 
background pixel, i.e. white, based upon its area grad- 
er* GS(ij). and associated U*, and Uax measures. 
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Description 

TFPHNIP.AI Fim /^TMF INVENTION 

The invention relates to a technique, specifically apparatus and an accompanying method, tor accurately thresh- 
olding an image based on local image properties, specifically luminance variations, and particularly one that uses multi- 
windowing tor providing enhanced immunity to image noise and lessened boundary artifacts. 

rapk^roiiND ART 

With digital image processing and digital communication becoming increasingly prevalent today, increasing amounts 
ot orinted or other textual documents are being scanned for subsequent computerized processing of one form or another 
and/or diaital transmission. This processing may involve, tor example, optical character recognition, for converting printed 
characters whether machine printed or handwritten, from scanned bit-mapped form into an appropriate character set. 
such as ASCII, the latter being more suitable for use with word processing and similar computerized document-process- 

^Ifnnino a orav-scale document typically yields a multi-bit. typically eight-bit, value for each pixel in the scanned 
rw^nt The value represents the luminance, in terms of a 256-level gray scale, of a pixel at a corresponding point 
nTrtlrnent These pixels are generated, depending upon the resolution of the scanner, frequently at resolutions 
™ T7 0 Dixe , s /jnch (approximately 80-160 pixels/cm), though with highly detailed images at upwards of 1200 or more 
nUte/inch (aoDroximately 470 pixels/cm). Consequently, a scanned 8 1/2 by 1 1 inch (approximately 22 by 28 cm) image 
Contain a considerable amount of gray-scale data. Inasmuch scanned text generally presents a written or printed 
eharVtfere of some sort against a contrasting colored background, typically white or black print against a white or light 
^ , reH h __ kQround of vlC e versa, the exact luminance value at any one pixel in the text is not as important as whether 
♦^T^TfeeHher oart of a character or the background. Therefore, scanned textual images, or scanned textual portions 
I^lrolr maoes containing both text and graphics, can be eff iciently represented by single-bit pixels in which each pixel 
2 a Snn^ ^fe simply set to. e.g.. a "one" if that pixel in the original image fe part of a character or part of 
£,L^ound information or to. e.g.. a "zero" if that pixel in the original image is part of the image background. To easily 
Hk=w..i E h the different types of scanned images, a gray-ievel image is defined as one having mutti-bit (hence mutti- 
«h 2 f nWelTwhereas a binary (or bi-level) image is formed of single-bit pixels. Furthermore, since binary images gen- t 
«ate considerably leSs data for a given textual image, such as. e.g.. one-eighth, as much as for an eight-bit gray-scale 
1", inn n , S a m e image, binary images are more efficient over conesponding gray-scale images and thus preferred 
Z^^B^m^T^n of textual images. Binary images are also preferred because of their easy conpresstoilHy 
usino standard compression techniques. e.g..CCITT Groups 3 or 4. compression standards. 

r ravT^le imaoes are converted to binary images through a so-called thresholding process. In essence, each mutt- 
hh nSJ virtue in a oray-scale scanned image is compared to a pre-defined threshold value, which may be fixed, variable 
or even adaotively variable, to yield a single corresponding output bit. If the multi-bit pixel value equals or exceeds the 
threshold value for that particular pixel, the resultant single-bit output pixel is set to a "one'; otherwise if the threshold is 
oreater than the multi-bit pixel, then the resultant single-bit output pixel remains at "zero". In this manner, thresholding 
%♦ thr.c«= nixels such as those which form characters, or other desired objects, from the background in a scanned 
n«v !ir!maoe with the pixels that form each character, or object, being one value, typically that for black, and the 
Sxels tor the background all being another value, typically that tor while. For ease of reference, we will hereinafter 
collectively refer to each character or other desired object in the image as simply an -object-. 

IdeaMv the best thresholding process is one which accurately selects all the object pixels, but nothing more, in the 
-canned image and maps those pixels to a common single-bit value, such as. e.g.. "one" for black In practice, noise. 
K^nmnnd shading lighting non-uniformities in a scanning process and other such phenomena, preclude the use of a 
S fi«d threshold tor an entire image. In that regard. H the threshold is too low. the resulting image may contain an 
^Liveamount of noise in certain. H not all regions; or. H too high, insufficient image detail, again in certain. H not aO. 
^rT- thereby complicating the subsequent processing of this image. Given this, the art recognizes that a preferred 
abroach would be to seled a different threshold value thai is appropriate to each and every pixel in the scanned image, 
i rinino so the proper threshold value is determined based upon local properties of the image, i.e.. certain image 
characteristics that occur in a localized image region for that pixel. Hence, the threshold would vary across the image. 
Dossibly even adapt to changing localized image conditions. 

in oeneral a common methodology for variable thresholding relies on measuring localized image characteristics. 
*ueh as local intensity contrast (or gradient), local averaged intensity and/or local variance, in a local window centered 
1*** a crixel of interest and then using these measures to classify image pixels into either object pixels, black, or back- 
around pixels white Here. too. reality diverges from the ideal inasmuch this methodology is complicated, and often 
f draiJrf hv'a need to extract various objects in a wide range of documents but with minimal user intervention, such 
astor Eposes of initialization and object identification, and while still yielding a clean background in the thresholded 
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images, the art has persisted by teaching , several ^^'^^^cksthat in practice, tend tolimHtheir utility. 
Smance. However, all these approaches sutler ^Xrl^ccatedTmage properties, are taught in M. Kamel et 
Pe,i Various approaches based ^^^l^gg^^J^, ^ 
al -Extraction of Binary Charatf er/GraphK* Images "w™?**™ . , , eve| . approach is based on comparing a 
J ! 3^ Ifi ce 5 sin a . Vol. 55. No. 3. May 1993. ^j^^ZX*** 'o^* 8 ' * 
^^TTg^en pixel or its smoothed gray ^ J ^ ^ o1 tne ^ pixe! „ soHciently belo* 

centered about tour pixels orthogonally ™ n t ° v ^*' 9 ™^ a „ ^.so-called "mask-based Subtraction-, relies 
aS lour local averages, then the ^t^SSS a character/graphics image. Fust, rnostof 
on considering every pixel a sun £ ostensibly functioning to remove -panW no*e. The 

the bacKground pixels are detected using a logical inter, me ™» ' through each given pixel with slopes 

Jter Wlied to tour pixel sequences that correspond to tour * "JJJSSCA P»els which are Hack and 

background pixels which are whitejhe. """^^"Zw character/graphics pixel, the gray level 

ground pixels using a predetermined stroke w '^^..^ u to ^^ pixete . Lastly, a gray-scale charaoter/graph- 
l hs background image is estimated by ^.^^^S^S^^m original scanned image with resulting 
SsTmage is obtained by subtracting ^'^^^^^JV^phics image. Though the global threshold 
Serenes then being globally^ 

value itself is fixed, basing the es ^ a difte ^ ™^ ^ approaC hes would appear to be somewhat jrnmune 

££. dim 4.868.670 issued to R.R.A. Morion et el . « S^en^er 

Another approach, es describee in unnea ier . GE on tracWno a background value in an image, with a threshold 
19. 1989 and owned by the present assignee hereof) ^J^JJJJ a feedback signal. Here, whenever a transition 
value being a sum of 8 » 8 ^£^^ 

occurs in the image, such as an edge, tne ,ee °™^ » threshobed pixel value has a reduced noise content. 

Sy the threshold value such thai oslensiHya" ™£ at intensity transitions due to abrupt changes 

tfesln d^erting low contrast objects to J.C. Stoffel et el on August 28 1984). 

A further approach is described ,n StatesPatenM/ ^ I ^ fe ^ a pixel ^ yi51xel 

Here, adaptive thresholding <^r££ X jSlhV^. This offset potential is used* conjunction 
basis as a function of whrte peak and ^^£S^a\ue tna t varies pi,el-by-pixel. The peak and valley poten- 
with nearest neighbor pixels to provide an ^1 potential of that pixel with predetermined minimum 

^e 8re earr I^^^^^X techno also appears to ex,** drtt^es in 

eUaring low contrast objects in a specHically apparatus and an accompanying method tor accu- 

Theretore. a need exists .n the art tor a }"*^J*™r^ ™ tein ^.ng a threshold that varies based on local 
ra ,e.y and re.iably thresholding • mTnrty an?reduced boundary artifacts, as well as 

Ss^ * ™ M VOr,aWe th ' eShOWin9 
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thresholding technique. nradient G(\\S is determined lor each pixelfi j) in an incoming 

tacHically. through ourinvention. a located *»»*£^2f^ t i„ us trative.y 3-by-3. of pixels centered 
scanned gray-scale bit-mapped image. This gradient « d ^ er ™ ne0 " 8 |evels are detected tor an N-by-N pixel window 

ac^ixe.^ 

centered over the image about p.xel(.j). In add.t on. « " n -2-by-n-2 pixels, centered about position OJ). 

"Tent is ascertained for a matrix (w-ndow) ofpixe po -£"M£^ Hy n2^J whrte. primarily based 

lach oixelfl j) is then dassified as being an object pixel. "acK w a Dacng ^ parameters are 

uponite S gradient. GS(i.D. and secondarily "P™ 

dSnedfor -chandlery pixe'^ and ^ ^e*. once the gradient 

^^"^ 
gradient 6S(i j). 
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Using these local measures, each image pixel(ij) is first classified as being near an edge or not. In that regard, each 
pixel near an edge is so classified if the local measures therefor, specifically its associated area gradient, exceeds a 
pre-defined threshold value. Otherwise, that pixel is viewed as falling within a locally flat field, i.e., of relatively constant 
gray-scale. Specifically, edge pixels are classified by comparing their intensity values against average intensity values 
tor local N-by-N pixel windows therefor; in contrast, pixels in flat fields are classKied by comparing their intensity against 
a predetermined intensity value. 

In particular, an image pixel(ij) located in a vicinity of an edge in the image is detected whenever the area gradient, 
GS(i j) for that pixel is high, particularly being larger than a predefined gradient threshold, GT. Once such a pixel Is 
found/each pixel on a darker side of the edge is found. This latter pixel being in the center of a local N-by-N, e.g., 7-by- 
7 pixel window is classified as an object pixel, i.e., black, whenever its intensity, L^, is smaller than an average of Hs 
associated L„,jn and L^x values. Alternatively, rf the intensity of this latter pixel, exceeds the average intensity value 
of Lm- and Lma*> then this particular pixel is classified as being background, i.e.. white. 

Where the area gradient GS(i j), tor pixelfi j) is less than the gradient threshold, such as where the N-by-N window 
slides along an image region of relatively constant gray-scale, pixel(ij) is classified by simple thresholding, i.e., thresh- 
olding its gray-scale value against a constant predefined threshold value, IT. Here, if the gray-scale value of pixel(ij) is 
less than the threshold value IT. this pixel is classified as an object pixel, i.e.. black; otherwise, this pixel is designated 
as part of the background, Le.. white. 

To enhance image edges end by doing so further increase thresholding accuracy, the intensity values of those pixels 
near an edge are modified. For the preferred embodiment, black pixels are illustratively represented by a value of 2ero 
and white pixels by a value of "1 Specifically, tor those pixels located on a darker side of an edge and having an intensity 
value that exceeds the threshold value, IT, the intensity of each of these pixels is reduced to a value slightly below 
threshold IT, e.g., to a value IT-, in contrast, the intensity values for those pixels, located on a brighter side of an edge 
and having an intensity value less than threshold value IT, are increased to an intensity value slightly greater than thresh- 
old value IT, e.g.. to value IT-k A high quality binary image can then be produced by merely thresholding the resulting 
gray-scale image against pre-defined threshold value IT. 

Advantageously, through the use of area (summed intensity) gradients, the present invention significantly reduces 
both background noise and boundary artifact generation while accurately extracting objects in a thresholded image. The 
modrf ied gray-scale image, when subsequently thresholded using a fixed threshold value IT, greatly enhances detection 
of low contrast objects and thus readily produces a high quality binary image 

RR1EF DESCR IPTION! OF THE DRAWINGS 

The teachings of the present invention may be readily understood by considering the following detailed description 
in conjunction with the accompanying drawings, in which: 

FIG. 1 depicts a high-level block diagram of document imaging system 5 that embodies the teachings of our present 
invention; 

FIG. 2 depicts the correct alignment ol the drawing sheets for FIGs. 2A and 2B; 

FIGs. 2A and 2B collectively depict a high-level flowchart of our inventive multi -windowing thresholding method; 

FIG. 3A depicts a 3-by-3 matrix of pixel location definitions which we use in determining, through a "Sober gradient 
operator, gradient strength for current pixel(ij): 

FIG. 3B depicts a graphical representation of an N-by-N neighborhood of pixels centered about a current pixel(i j) 
in an image intensity record; 

FIG. 3C depicts a graphical representation of an (N-2)-by-(N-2) neighborhood of pixels centered about pixel position 
(i j) in an image intensity gradient record; 

FIG 4 graphically depicts intensity profile 400 of an illustrative scan line of an original gray-scale image, such as 
that illustratively on document 10 shown in FIG. 1; 

FIG. 5 graphically depicts a modified intensity profile which results after thresholding intensity profile 400 shown in 
FIG. 4 according to the teachings of our present invention; 

FIG. 6 depicts a block diagram of a preferred embodiment of our present invention; 
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FIG. 7 depicts a block diagram of Sum of Gradients Circuit 620 which lorms part of circuit 600 shown in FIG. 6; and 

FIG. 8 depicts a block diagram of 7-by-7 Maximum and Minimum Detector 635 which also forms part of circuit 600 
shown in FIG. 6. 

7o facilitate understanding, identical reference numerals have been used, where possible, to denote identical ele- 
ments that are common to various f igures. 

MQPEg HP C&RRYjNg ™ " T "E INVENTION 

10 iH*r readino the following description, those skilled in the art will quickly realize that our invention is applicable tor 
llriv anv document imaging system for accurately thresholding scanned documentary images conta.n.nghne 
use m " earf y ^^XTtl^t «ne Tar contains and the media upon which the image originally appears. For example. 
^ '^ISoZ^ m^ cha? 8 aers and/or .ine <ske,etaidrawings. Nevertheless tor the purpose of simp.lty.ng 

7,^1 letters and numbers, which we wiB collectively reter to here.nafler as objects . _ _ 

as textual letters ano ~ ^ discussion, we define Hack and white gray-scale pocels as having e.ghl-bH gray- 
■ ^iST^^SniScL* For consistency, we e.so define output binary pixels > wHh , black being ^ and 
S^no-r Cleady ourinvemivem^ 
*> t^SZ that Ware pixel intensities, as would be readily apparent to those skilled ,n the art. reversed trom those 

8 ^^ct^high-level block diagram of document imaging system 5 that embodies the teachings ^urpresent 
I \ e Z! system 5 is formed of gray-scale scanner 20. digital image processor 30 and "simple" ttueshold.no 
"""S to SSS^Z^O contafnirJg various objects of interest is scanned by scanner 20 to produce muft- 
cucurt 40. n oP^^^ned Grayscale image data. L This data is routed, via leads 25. to a data input of d.grtal 

"""SKEE!^ nm^ge on leads 37 and an output binary image on leads 33. The modified O^y-scale .mage, as 
a modrf,ed . eray S ^ heiow has its edges enhanced by processor 30 to subsequently increase thresholding accu- 
descr ibed in greater detail below, has its eoges ^nnanceo yy thresholding circuit 40 which 

raC y. The modified gray-sca e .mage ^ 'm^ofdato ^sfapre^e^ned fixed threshold value thereby 



30 



35 



40 



45 



50 



55 



^^soSled^simple- thresholding. The resulting thresholded. i.e.. binary, image produced by circuit 40 is allied 
P -T2IT? ano^eToutout binary image. Digital image processor 30 performs thresholding ,n accordance w*t our 
yia leads 45. as a™^*' ^ y throughputs required tor processing bit-mapped images, processor 30 » prefer- 

ment >me ^^^ x ^Z,^ ^!X i^^ our inventive circuit 600 shown in FIG. 6 and discussed in 
??^aZZw^X?^< be impleme'ed through one or more genera, purpose miacprc.essors. 
detail below. Alternatively, p *\ cllHah . v Dr oa rammed to implement our present invention in soft- 

^:^z^^^X^^ «~ - to - data 

,hr °f !Sl". e ve. flowchart of our inventive multi-windowing thresholding method 200 is collective^ depicted in FIGs. 2A 
,nd » ^ toTwhTch^rrect alignment of the drawing sheets tor these f igures is shown ,n FIG. 2. During the course ot 
and 2B, tor w ™^ n * e1erence will also be made to FIGs. 3A-3C where appropriate. 

discuss-ngmethod 200 ™™ grav . sca , e pi > e i in an incoming image, thereby iterating through the 

• M l£e ^the XeThZh wh^ay ile image pixel is processed is identical across a» such pixels, we 
ima ge. S nee the i ma ' nne " ~ of processing generalized pixel(ij). where i and j are posrtive integers and 

m "Z^^aTrt^^Z the incomtog grayscale image. In addhton to gray-scale image data, 
define l^ 1 ^ 6 ^ , ^ paremeters . specifically fixed thresholds IT andGT. These thresholds are adjusted. 
6 T betot?Hher^o provide satisfactory mresholding across a multitude of dmering umges with varying char- 
*l £ Jct7sco^** and illumination, or can be adjusted to provide optimum thresholding for any one type of 
^Mr ^nnino^ondrtion. In any event as a result of perlorming method 200 on all such gray-scale '™gep«els. 

LTh^^ 

HS3 fbei^ ^The r^drtied gray-Sle image can then be further processed. e.g.. through scaling o, filtering, as 

Uniarticular upon starting method 200. step 203 is first performed. This step determines a gradient ^engtMor 
In particular y , ^ so^ nfxi - S obel* gradient operator on a window of pocels centered about 

P ^!^sho^^^^ 

«£d "«■« below, the Sobel operator relies on computing horizontal and vertical pixel intensity gradients. 
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GX(i.j) and GY(i,j), respectively, and for each pixel position forming the gradient strength, G(i,j) as an absolute sum 
ofGX(ij) and GY(ij): 

GX(ij) = L(k1 j-1) + 2L(i+1 j) + L(i+1.j+1) - L0-1 j-1) ■ 2L(i-1 j) - L(i-1 j+1) (1) 
GY(ij) = L(i-1.j+1) + 2L(i.j+1) + L(i+1 j+1) - L(i-1 j-1) - 2L(i,j-1) - L0+1 j-1) (2) 
G(ij) s |GX(ij)|4|GY(i,D| (3) 

where: G(ij) is the gradient strength at pixel position 
(i j); and 

L(ij) is the image intensity, luminance, at pixel 
position (ij). 

The resulting gradient strength value for every image pixel collectively forms a gradient strength record for the entire 
scanned image. 

Once the gradient strength, G(ij), is determined for pxel(ij), method 200 advances to step 206. This step, when 
performed, determines the area gradient for pixel position (ij), i.e., GS(ij), as the sum of the gradient strengths for each 
and every pixel position within an (N-2)-by-(N«2) window centered about pixel position (ij). This window is illustratively 
5-by-5 pixels in si2e end is shown, as window 370, in FIG. 3C tor an N-by-N. illustratively 7-by-7, window shown in FIG. 
3B the latter being window 330, centered about pixel(i j). For purposes of comparison, the periphery of ah N-by-N 
window is shown as window 350 in FIG. 3C. Though shown sequentially to simplify illustration, step 245 is generally 
performed at essentially the same time, as symbolized by dashed line 244 , as is steps 203 and 206. Step 244 deter mines 
both minimum and maximum pixel intensity values. and L^,. respectively, in an N-by-N window centered about 

pixeKi j). 

Once the area gradient is determined for pixel position (i j), then, through the remainder of method 200, the three 
image measures, GS(ij) and L™ and L^. associated with this particular pixel position are used to classify pixel(i j) 
as an object pixel, i.e.. back, or a background pixel, i.e.. white. 

In particular, decision step 208 is performed to assess whether the value of the area gradient for pixel(i j). i.e.. GSfi.j), 
exceeds a pre-defined threshold value. GT, or not. This test determines whether pixelfi j) lies in a vicinity of an edge in 
the scanned image, or not. If the area gradient is less than the threshold value. GT, then pixel(ij) does not lie near an 
edge. Hence, pixelO j) lies within a localized relatively constant tone, i.e., Hat" field, region of the scanned gi ay-scale 
image. In this case, method 200 advances along NO path 211 emanating from decision block 208 to decision block 215. 
This latter decision block determines whether the gray-scale intensity of pixel(i,j), i.e.. L^, exceeds another pre-defined 
threshold value. IT. rf this gray-scale value is less than the threshold, the pixel is classified as an object pixel, i.e., here 
black; otherwise, the pixel is classified as a background pixel, i.e., here white. Specifically, on the one hand, H pixel 
intensity, L* is less than or equal to threshold IT, decision block 215 advances method 200, along NO path 217, to 
decision block 222. This latter decision block determines whether a user has previously instructed the method to produce 
a binary or gray-scale output pixel. It a binary pixel is desired, then decision block 222 advances the method, via YES 
path 225, to block 228 which, in turn, sets an intensity of output pixel(ij) to black, i.e., zero. Alternatively, if a gray-scale 
output is desired, then decision block 222 advances method 200. via NO path 224, to block 230. This latter block, when 
performed, sets the intensity of output pixel(i.j) to the intensity of L^, without any modifications made thereto. If, on the 
other hand, pixel intensity, Lc. exceeds threshold IT, decision block 215 advances method 200. along YES path 218, to 
decision block 232. This latter decision block deter mines whether a user has previously instructed the method to produce 
a binary or gray-scale output pixel. If a binary pixel is desired, then decision block 232 advances the method, via YES 
path 235, to block 237 which, in turn, sets an intensity of output pixel(i.j*) to white, i.e., one. Alternatively, H a gray-scale 
output is desired, then decision block 232 advances method 200, via NO path 234, to block 241 . This latter block, when 
performed, sets the intensity of output pixel(ij) to the intensity of L^, without any modifications made thereto. Once step 
228, 237 or 241 is performed, method 200 is completed tor pixel(i j); the method is then repeated for the next image 
pixel in succession, and so forth. 

Alternatively, if area gradient, GS(i,j) exceeds the threshold value, GT, then pixel(ij) lies in the vicinity of an edge. 
In this case, step 245 is now performed to ascertain the values of L mBX and L^. if these values have not already been 
determined! as set forth above. Thereafter, method 200 advances to block 248 which calculates an average pixel intensity 
value, Ley /occurring within the N-by-N pixel window centered about pixel position (i,j). This average intensity value is 
simply determined by averaging the values Una, and L^. 

Once this average value has been ascertained, method 200 advances to decision block 251 which compares the 
intensity of pixel(ij). i.e., against its associated average intensity value, La vg . When this pixel is situated on a darker 
side of an edge and hence an object pixel, then its associated average intensity value will be greater than or equal to 
its intensity value, Lc- In this case, the output binary pixel for pixel position (ij) will be set to black. Otherwise, if pixel(ij) 
is situated near an edge but its average intensity value. L avg , would be less than its intensity value, Lc then this pixel is 
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increase thresholding accuracy. n less than or equal to ils associated average intensity value. 

,n particular. H gray-scale pixel ' rte < ^^^ ^ShSJ ^decision block 260. This latter decision block 
. then decision block 251 advances method 20O .along NO P™£* bi ^ ^.scaie output pixel. H a 

d&es whether a user has previously fueled I the me* '^to produce a * y gr y ^ ^ 

btoary pixel is desired, then ^^^.^^ ^^^ e ^^ H^gray-sGale output is desired, then decision block 260 

sets an intensity of output p«el(. j) to btacK ^ zero. However nag ay penned, determines whether 

advances method 200. via NO path 262^0 jtan block 27 • ™^ j} fe tess ^ „ ^ to ,«« 

pixel intensity. U. exceeds the pre-det, ^^fj^, ^executed, sets the grayscale output tor 
IT then method 200 advances, along NO 272. lol ™» J 7 * exceeds the ^ue ot threshold IT, then method 

v!lue a thtt n is slightly less. IT-, than threshold I IT. intensity value. L^, thendecfeton block 

Anernatively. H 1^^^X^^££^SS^ This" latter decision bloc?determines whether 
251 advances method 200. abr* YES path 2 ^^'°™°^ ^ output pixel. H a binary pixel is desired, 
a user has previously inspected <**™«^Z^*£^ to Wock285 which, in turn, sets an intensity of output 
then decision block 280 advances the metrxxJ^ YES^th ZeZ^ tc^c bloc * 280 advances method 200. 

pixe.0 j) to white. i.e.. one. However rf ^SSSl^tlS^ de,e ' mineE ^ inten81 * ^ * 

via NO path 284. to decision Hock 290. J^.^ 6 ^^f" Pe ^ eed8 OT fe eq ua | to threshold IT. then method 200 
Zn pre-defined threshold value IT. If the .men** of ' P» e JW> tSsT* N2y*cal« output tor pixel(ij) to the pixel 
alaLs. along NO path 292 to ^£JJ*£ £££X?S£! method 200advances. along YES oath 
intensity value Now. H he-tensrty^ p^Kjfl >»*^£E£ pi el f, j) to a value that is slightly larger. i.e, IT*. 
294 to block 297. which, when executed, sets the Bray-scale oupu. or p \£ s _ |ye , threshold IT is not critical 

£ threshold rr. The £ 285 2^ 2 9 1 hat oTen pertormedtor pbcelftj): method 200 is 

and is empirically determined. Once step 268. 275. 285. ^o « 

then repeated tor the "^l™ 0 *^^^ depicts intensity profile 400 ot an illustrative scan 

With this understanding n mrnd. ^^ e ^.. A J^^°^^j' merti 10s howninFlG. 1. Asa result ot processing 
Hne of an original gray-scale image ^such astha ""^ £hown in F ,a 5. results. As is readily apparent 
profile 400 through J""^ S^^SSKES of the image pixels located near an edgeare modrlied^ 
trom companng profiles 400 a ^^°-°"^ 9 y rf ^ and whi | e its intensity is larger than threshold 

in .his regard, when such a p,xe I .tort* ^.^^^^^stnan threshold IT. Alternatively, when an image 
value IT. the intensity of thrs pixel .e ^««* £ 8 J*£ ] * te less than threshold IT the intensity ot this pixel is 

As shown, circuit 600 is formed of l.ne d ^^ 10 * *^™ ,y ™ 650 and 655; 7-by-7 Max and Min detector 635; 
gra d£nt detector 615; sum of gradients •^^^S^ZSdt inverter 664. and gates 662. 670 and 
averaging drcuit 640; multplexors 680 and 6W and BfJJJ^J™ an£j 2B and discussed in detail above. 

, 675. Circuit 600 collect^ ^ m ^^JltSte^^ parallel, via leads 60S and 608. to an input of 
,n operation, eight-bit .nput gray-scale : mage, '°^ D £ 610 , specifically series-connected single 
,ine de£s 610 and to an hput of 7^-7 Max and M,£ J^^^J^ £ centered around image pixe.(i.j). 
line delay elements 610,. 610 2 and 610 3 . provide a 3 ^"T" 8 £ < ^ window . outpute of all three 
Each de!ay element is tapped at three f^f^^^Z^^. thiough calculation of the Sobe. 

, delay elements are routed to respective inputs of gradient detect on c^ output leads 617. This 

curator, as described above, provides an 'T^^^^J^S^. sums al/the gradient intensity values 
Jadient value is applied to an input V^S^Ji^SSX esultant sum. as an area gradient value, i.e.. 
fn a S-by-5 window centered about p.*e position^ Oj) ^ ™ * discussed in detail below. Thrs area gradient value 
GSClj). on 12-bit ^JSS^S JSST^^ S vSue against predefined gradient threshed. GT; 

s i S applied to an input JA ) d I cornparat or 62 5 ^f^^^. ^ ieS uning comparison output, appearing on 
the latter being applied to another input (B] rto the : same c mpa comparison output is applied as an 

'^'a^r?^ 69 °- 35 diSCU£Sed dCtan ^ ^ aPPrOPri8,e 

gTay-s^ o^ 2 U.. L. or one ot the predef ined values .T- or !T + . 



7 



EP 0 712 094 A2 



Max and Min detector 635, depicted in FIG. 8 and discussed in detail below, ascertains the maximum and minimum 
pixel intensity values, i.e., L^ax a™* Lmin. of those pixels contained within a 7-by-7 window centered about pixelfij). 
Resulting L max and L min values, appearing on leads 637 and 639, are then averaged by averaging circuit 640. This droit 
contains summer 642, which merely adds these two values together into a resultant sum, and 12 and delay circuit 646 
which inplements a divide by two operation by shifting the sum one-bit to the right; hence dropping the least significant 
bit. The resultant averaged intensity value is then appropriately delayed within circuit 646 tor purposes ol achieving 
proper synchronization within circuit 600. 

If the area gradient value, GS(i,j), exceeds the pre-defined gradient threshold, GT, then the averaged intensity value, 
L used as a threshold level in determining the value of output center pixel(i j); else, H the area gradient value is less 
than or equal to the gradient threshold, then value IT is used as the threshold level in determining the value of output 
center pixel(ij). In this regard, the averaged intensity value, L avg , is applied to one input of comparator 650. The current 
center pixel value. Lc is applied through delay element 630 to another input of comparator 650 as well as to one input 
of comparator 655. The delay of element 630 is set to assure that the proper corresponding values of and are 
synchronously applied to collectively comparators 650 and 655, multiplexors 680 and 690, and gating circuit 660. The 
fixed threshold value, IT, is applied to another input of comparator 655. Comparator 650 produces a low or high or low 
level output on lead 653 if pixel intensity value 1^ is less than, or equal to or greater than, respectively, its associated 
averaged intensity value. L* V g. This output level is applied to both one input ("1") of multiplexor 680 and one input of 
AND gate 662. Multiplexor 680 selects the output binary pixel as between two bits generated from using two different 
thresholds, i.e., value IT or L evg . In that regard, comparator 655 produces a high output level at its A>B output whenever 
the predefined threshold value IT is greater than pixel intensity value Up. The level at output A>B is routed, via leads 
657, to another irput CO") of multiplexor 680 and to one input of AND gate 670. Multiplexor 680 produces the output 
binary value for pixel(ij). To do so, the comparison output level produced by comparator 625, indicative of whether the 
area gradient, GS(i,j), exceeds the gradient threshold, GT, is applied as a select signal, via lead 628, to a select fS") 
input of multiplexor 680. If this select signal is high, thereby indicating that the area gradient exceeds the gradient thresh* 
okJ. then multiplexor 680 routes the level applied to its "1" input, i.e.. that generated by comparator 650. to binary output 
lead 33; else, the multiplexor routes the level then appearing at its "0" input to lead 33. 

Multiplexor 690 routes the center pixel value. or a pre-defined value IT+ or IT- as the output gray-scale value to 
eight-bit output leads 37. Pre-defined values IT+ and IT- along with center pixel value Lc are applied to different corre- 
sponding eight-bit inputs to multiplexor 690. The output of this multiplexor is determined by the state of two select signals, 
SO and SI: if these signals assume the binary values 2ero. "1" or -3", then the multiplexor will route center pixel value 
Uc, value IT+ or value IT-, respectively, to output leads 37. Gating circuit 660, in response to the comparison output 
sionals produced by comparators 625, 650 and 655 generates, by simple combinatorial logic, the two select signals, SO 
and Si, applied to multiplexor 690. Specifically, if the area gradient is not larger than the gradient threshold, then, as 
discussed above, gray-scale pxel value Lc, without any modification, will be applied through multiplexor 690, to output 
leads 37. Alternatively, if the area gradient exceeds the gradient threshold, then multiplexor 690 will apply ether value 
IT+ or IT- as a modified gray-scale output value to lead 37 based upon whether center pixel intensity value is less 
than its corresponding average pixel intensity value, L^, or not. Since the operation of gating circuit 660 is self-evident 
from the above description to anyone skilled in the art, it will not be discussed in any further detail. Values IT- and IT+ 
are merely held in appropriate registers (not shown) and from there applied to corresponding inputs of multiplexor 690. 

FIG. 7 depicts a block diagram of Sum of Gradients Circuit 620 which forms part of circuit 600 shown in FIG. 6. 
Circuit 620. as shown in FIG. 7, is formed of adder 710 and line delays 720, the latter containing tour series-connected 
single-line delay elements 720 0 , 720 1( 720 2 and 720 3 . Incoming gradient intensity values are applied, over lead 617 
from gradient detection circuit 615 (shown in FIG. 6), to one input of adder 710, shown in FIG. 7. In addition, the output 
of each of the four line delays 720 is routed over a different one of four feedback leads 715 to a different corresponding 
input of this adder. As a result adder 710 forms partial sums of 1-by-5 gradient values which are applied, as input, to 
delay element 720o. To generate a 5-by-5 sum of the intensity gradients, hence producing en area gradient measure, 
tour preceding conesponding 1 -by-5 sums are added together within adder 710 to a present 1 -by-5 sum, with the result- 
ant overall 5-by-5 sum being applied to output lead 622. Use of these delay elements connected in this fashion substan- 
tially reduces the amount of logic that would otherwise be needed to generate twenty-five intermediate sums. 

FIG. 8 depicts a block diagram of 7-by-7 Maximum and Minimum Detector 635 which also forms part of circuit 600 
shown in FIG. 6. As noted above, detector 635 determines the maximum and minimum pixel intensity values, and 
Lmin respectively, within a 7-by-7 window centered about pixel posrtion(i,j). This detector is formed of two separate 
circuits- maximum detecting circuit 805 and minimum detecting circuit 840 which extract a pixel value having a maximum 
and minimum intensity value, respectively, of all the pixels contained within the 7-by-7 window centered around plxel(ij) 
and respectively apply those two values to leads 637 and 639. Circuit 805 contains maximum detector 810 and line 
delays 820, the latter being formed of six series-connected single-line delay elements 820o, 820i, 820 2 , 82O3, 820 4 and 
82O5. Similarly, circuit 840 contains minimum detector 850 and line delays 860, the latter being formed of six series- 
connected sinole-line delay elements 860 0 . 860 1f 860 2t 86O3. 86O4 and 86O5. Inasmuch as circuits 805 and 840 function 
is an identical manner with the exception that detector 81 0 locates maximum values while detector 850 locates a minimum 
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15 



20 



SO 



35 



40 



, c hoth from the same series of pixel intensity va.ues applied over .ead 608. we will only discuss circuit 805 in detail; 
" " u^ ^hl art w^l then readHy appreciate how circuit 840 functions from this discussion, 
those skilled in the art wiinnen reao y maximum detector 810. In addition, the 

output of SS^^S^cSloi 8!0 extracts the maximumpixe. intensity valuefrom a 1-by-7 series of puce, 
detector.^nsequent^. max mu ^ ^ sot preceding corre- 

values and applies this maximum vaiue <» h ' detector 8 i0 locates the maximum pixel intensity 

sponding maximum pixel ^ ,u * output to leads 637. Here, the use of 

-^ectSi^ 

"generate image produced by our invention is controlled 

As one can now a PP' ec,a ^'J n !^ ua "J J^L^L G a T fe set t0 DI0oe rly classify image pixels located in the vicinity 
by the values deiin«Mo^^^ 

of edges in an image. A relatively low GTva u€ i lenos ^ic ^exiraci ' » h ^ „. value tenete to classlly 

pixels of a unrform gray rey»ui *« pchnid IT In this situatton, the value of threshold GT 

Eposes performs ^T^Z^X^*^ pixels by essentially so.efy corn- 

will always be larger than the area ^^J^JSrtd |T 9 Qur invention on also produce an outline image through 

p£« 

the art 

.-n. ^TP.AI APPLIC AR II ity and advantages 

Tna resent invent- is usefu, in image ^^^^^^^^'Z^ 

T^'^ * e — - iTOSe ar * £ ™ iy 

eliminating boundary artifacts from a thresholded image. 



45 



Claims 
1. 



so 



55 



2. 



A method to* thieshottfing an 
rt^^eS^htSTsSiM value and the maximum and minimum pixel valuaa. a eunerton. ol 

■** 5-*- « >" ,h « ^ imaoe M0 - ou,p ' , ' ■*"' " 6 eo " espo " < " n » 

position in the first output image. 

-n. 4^ «i rl a im 1 wherein the area gradient ascertaining step comprises the steps of: 

delln ^o,'mto .ha ftst window of imensity o.adiem valuaa from tha plurality ol intensity otadien. valuaa and. in 
lesponse lo said »al window, delerminino said araa (iradienl value. 



9 



cvrjrv *FP 0712094A2.L> 



EP 0 712 094 A2 

4. The method in claim 3 wherein said thresholding step comprises the steps of: 

comparing the area gradient value, GS(i j), to a pre-defined gradient threshold value, GT, so as to produce 
a comparison signal indicative of whether a current one input pixel located at the current pixel position (ij) in the 
input image lies in a vicinity of an edge in said input image; 

H the corrparison signal indicates that said current one input pixel does not fie in the vicinity of the edge, 
thresholding, in response to said comparison signal, said input pixel value at position (i j) in the input image against 
a pre-defined fixed gray-scale threshold value, IT, to yield a corresponding binary output value at pixel position (i j) 
in the f irst output image; and 

H the comparison signal indicates that said one current input pixel does lie within the vicinity of an edge, 
setting, in response to said comparison signal, said corresponding binary output value to a first or. second state if 
the current one pixel value either exceeds or is less than an average of the maximum and minimum pixel values, 
respectively. 

5. The method in claims 3 or 4 wherein said intensity gradient measuring step comprises the step of producing the 
intensity gradient value for the current pixel position by processing said third window of input pixel values through 
a Sobel operator. 

6. The method in claim 5 wherein the third window is a 3-by-3 window of input pixel values and the Sobel operator 
implements the following equations: 

GXflj) «= L0+1 + 2L(h1 j) + L(k1 j+1) - L(M j-1) - 2L(MJ)'- L0-1 J+1); 

GY(iJ) « L(i-1 J+1) + 2L(ij+1) + L(k1 j+1) - L(i-1 j-1) - 2L(ij-1) - L(i+1.j-1); 

and 

G(ij)HGXflj)|+|GY(ij)| 

where: L(i j) is an input pixel value, in luminance, tor 
the pixel position (i j) in the input image. 

7. The method in claim 4 further comprising the steps of: 

producing, in response to said comparison signal and the pixel value (Lc) at the current pixel position (i j), a 
modified gray-scale output pixel value at position (i j) in a second output image, wherein, H the comparison signal 
indicates that the one current irput pixel does not lie in the vicinity of the edge in said input image, the modified 
gray-scale output pixel value is set equal to the pixel value Lq, or if the comparison signal indicates that the current 
one input pixel does lie in the vicinity of the edge, the modified gray-scale output pixel value is set equal to a pre- 
defined value greater than or less than the threshold value IT when the pixel value Lc is greater or less than, respec- 
tively, the threshold value IT; and 

thresholding the modified gray-scale output pixel value, against the threshold value IT, to yield a corresponding 
second binary output pixel value at a pixel position (i,j) within a second output image. 

8. Apparatus for thresholding an input gray-scale image into a first output image, wherein said input image is formed 
of input pixels each having a multi-bit gray-scale pixel value associated therewith, and wherein said first output image 
is formed of pixels each having a corresponding output pixel value associated therewith, characterized in that the 
apparatus utilizes the steps recited in any of claims 1-7. 
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